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ABSTRACT 


The  Navy  Instructor  Attitude  Inventory  (NIAI)  was  developed  for  measuring  those  attitudes 
of  instructors  believed  to  be  factors  in  the  ability  of  instructors  to  effect  desirable,  harmonious 
relationships  in  their  classrooms.  An  account  of  the  development  of  the  NIAI  is  presented. 

Data  from  a  sample  of  seventy  instructors  are  utilized  in  two  validation  analyses.  One 
analysis  involves  multiple  regression;  the  other  analysis  involves  linear  discriminant  functions. 

In  both  analyses  a  continuous  externally  defined  criterion  is  used.  The  criterion  is  a  composite 
of  ratings  made  by  students  and  by  an  educational  specialist  who  had  been  supervising  the  seventy 
instructors. 

Two  prediction  equations  and  four  classification  equations  are  presented  and  their  deriva¬ 
tions  indicated.  These  equations  are  verified  on  the  group  or  groups  from  which  they  were 
derived.  Suggestions  are  made  for  cross -validation  and  possible  application.  Some  advantages  of  the 
discriminatory  technique  over  multiple  regression  are  described  and  illustrated.  Other  compari¬ 
sons  of  the  two  techniques  of  analysis  are  also  given. 
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INTRODUCTION 


This  report  deals  with  a  continuation  of  the  attempt  to  measure  the  ability  of  a  military  in¬ 
structor  to  effect  harmonious  interpersonal  relations  in  the  classroom.  A  previous  attempt  had 
been  made  to  measure  this  ability  by  using  the  Minnesota  Teacher  Attitude  Inventory  (MTAI)  in  a 
naval  school  setting,  with  inconclusive  results  (2).  The  rationale  for  using  MTAI  scores  as  mea¬ 
sures  of  this  ability  to  establish  harmonious  interpersonal  classroom  relations  was  based  on  the 
development  of  the  instrument  and  subsequent  validation  studies  with  it  (1).  The  results  of  these 
studies  indicated  that  the  MTAI  could  predict  the  nature  of  teacher-student  relations  in  the  class¬ 
room  about  as  well  as  academic  achievement  can  be  predicted  by  means  of  intelligence  tests  (1). 

The  use  of  the  MTAI  as  predictor  of  harmonious  interpersonal  classroom  relations  in  a 
naval  school  is  discussed  elsewhere  (2).  The  conclusion  at  that  time  was  that,  for  the  group  of 
instructors  under  investigation,  the  MTAI  was  not  a  significant  predictor  of  the  criteria. 

The  hypothesis  was  then  advanced  that  those  attitudes  of  the  instructors  in  the  naval  school 
which  were  measured  by  the  MTAI  were  not  the  attitudes  most  relevant  to  the  creation  and  main¬ 
tenance  of  harmonious  interpersonal  relations  in  a  naval  or  military  school  situation.  It  seemed 
advisable,  therefore,  to  try  to  determine  those  attitudes  which  are  related  to  the  creation  and 
maintenance  of  such  relations,  create  a  scale  or  inventory  based  on  the  attitudes  so  related,  and 
to  make  a  study  of  its  effectiveness. 

Accordingly,  a  new  scale  was  drawn  up.  This  scale,  known  as  the  Navy  Instructor  Attitude 
Inventory  (NIAI)  consisted  originally  of  300  items.  Ninety  of  these  items  were  selected  by  empiri¬ 
cal  methods  from  the  MTAI  (form  BX)  and  from  the  TAI  (form  CX)  both  of  which  had  been  used  in 
the  previous  validation  study  (2).  The  empirical  method  used  in  selecting  these  items  was  as  fol¬ 
lows:  The  MTAI  answer  sheets  of  the  group  of  instructors  at  the  naval  school  were  broken  down 
into  upper  and  lower  groups  (upper  50%  and  lower  50%  of  the  N)  based  on  the  criteria.  An  item 
analysis  of  the  MTAI  was  then  run  and  those  items  which  were  found  to  discriminate  at  the  20% 
level  of  confidence  or  better,  between  the  upper  and  lower  criterion  groups  were  selected  for  use 
in  the  NIAI.  Also,  certain  MMPI  items  which  seemed  to  discriminate  between  the  upper  and  lower 
groups  were  selected  and  rewritten  for  the  five-category-type  response  which  the  MTAI  items 
used  and  which  the  NIAI  items  would  also  use. 

Additional  items  were  written  and  chosen  on  logical  bases  for  measuring  those  attitudes 
which  the  investigators  felt  contributed  to  harmonious  relations  in  a  naval  school  For  example, 
analysis  of  the  validation  study  using  the  MTAI  as  a  predictor  (2)  gave  some  indication  that  there 
was  a  positive  relationship  between  how  “good”  an  instructor  was  (in  terms  of  how  highly  the  com¬ 
bined  criteria  rated  him)  and  the  amount  of  formal  schooling  the  instructor  had  had.  This  led  to 
the  hypothesis  that  if  the  “good”  instructor  had  had  pleasant  school  experiences  and  the  "poor”  in¬ 
structor  had  less  pleasant  ones,  then  it  might  be  possible  to  construct  items,  based  on  known  rea¬ 
sons  why  people  dropped  out  of  school,  which  would  separate  those  instructors  who  had  gone  on  in 
school  from  those  who  had  dropped  out.  In  other  words,  such  items  might  be  one  way  of  discrim¬ 
inating  between  “good”  and  “poor”  instructors  on  an  attitudinal  basis.  Thus,  items  based  on  past 
school  history  and  experiences  were  constructed  and  included  in  the  NIAI  on  a  logical  basis  for 
the  reasons  just  given. 

Once  the  new  inventory  was  drawn  up,  the  next  step  was  a  study  of  the  effectiveness  of  the 
NIAI  with  a  group  of  instructors  in  a  naval  school. 

Procedure 

Administration  of  Inventory  and  Obtaining  the  Criterion  Data 

This  study,  like  the  previous  one,  was  conducted  in  the  Airman  School  (Class  P)  of  the 
Naval  Air  Technical  Training  Center  at  Jacksonville,  Florida.  The  inventory  (NIAI)  was  adminis¬ 
tered  to  a  sample  of  70  marine  and  navy  instructors.  These  instructors  were  non-commissioned 


officers,  most  of  whom  had  been  instructing  in  the  school  about  two  years.  They  were  advised 
that  their  scores  on  the  NIAI  would  in  no  way  affect  their  status,  that  this  was  part  of  a  study  of 
the  personal  attitudes  and  characteristics  of  instructors  in  a  military  school.  Most  of  the  group 
seemed  cooperative  and  can  be  assumed  to  have  made  conscientious  efforts  to  complete  the  inven¬ 
tory  properly.  However,  there  were  a  few  who  objected  to  this  extra  call  on  their  time,  and  these 
few  may  not  have  responded  to  the  NIAI  as  requested. 

As  a  criterion  measure,  the  student  questionnaire,  referred  to  elsewhere  (2,  Appendix  A), 
was  administered  to  the  student  trainees  in  each  of  the  instructor’s  classes.  A  few  classes  had 
known  their  instructors  for  only  about  10  hours.  For  this  reason,  some  of  the  students’  question¬ 
naires  might  not  be  as  valid  and  reliable  evaluations  as  those  of  the  educational  specialist  who  had 
known  the  instructors  for  a  much  longer  time. 

Further  criterion  data  in  the  form  of  a  rating  of  each  of  the  instructors  by  the  civilian 
educational  specialist  in  the  school  were  obtained.  Additional  data  were  obtained  involving  vari¬ 
ables  which  might  prove  helpful  and  illuminating  in  the  study.  They  will  be  cited  later  on.  The 
rating  of  each  instructor  by  his  immediate  supervisor  and  the  evaluation  of  the  instructor  by  an 
observer  in  the  classroom  were  not  obtained  as  criterion  measures  for  this  preliminary  analysis 
as  they  were  in  the  study  involving  the  MTAI  as  a  predictor  due  to  time  limitations  (2). 

Development  of  Content  Scales 

Before  any  validity  analysis  was  made,  it  was  decided  that  the  items  of  the  NIAI  should  be 
grouped  and  classified  into  separate  scales.  This  was  done  by  the  pooled  judgment  of  five  consult¬ 
ants  on  the  project.  The  rationale  for  the  assignment  of  items  to  subscales  was  as  follows:  Items 
that  were  judged  to  deal  with  attitudes  of  the  instructors  towards  various  school  or  classroom 
situations  were  grouped  into  a  teacher  attitude  (TA)  scale.  These  items  were  mostly  the  MTAI 
items  selected  for  the  NIAI  because  of  previous  empirical  evidence  (3).  Items  judged  to  deal  with 
attitudes  towards  situations  that  may  have  occurred  in  the  past  school  history  of  the  instructor 
were  grouped  into  a  past  school  experiences  (PSE)  scale;  items  judged  to  deal  with  the  personal 
adjustment  of  the  instructor  (mostly  Minnesota  Multiphasic  Personality  Inventory  type  items)  were 
grouped  into  a  general  adjustment  (GA)  scale  (5). 

Development  of  Verification  Scales 

It  was  decided  to  construct  a  scale  based  on  statistical. rarity  of  responses.  A  complete 
item  count  in  terms  of  item  difficulty  was  run  on  every  response  category  of  every  original  NIAI 
item.  This  item  count,  plus  data  on  responses  obtained  in  the  first  three  validation  studies  of  the 
MTAI  and  response  data  from  the  previous  study  at  the  Airman  School  (2)  were  used  as  the  bases. 
This  scale,  called  a  verification  (V)  scale,  was  not  necessarily  a  content  scale  but  was  considered 
similar  to  the  F  scale  on  the  MMPI,  the  V  scale  on  the  Kuder  Preference  Record,  and  the  V  scale 
on  the  MTAI. 

Included  in  this  scale  were  any  and  all  item  response  categories  of  the  NIAI  which  had 
been  chosen  by  10%  or  less  of  the  instructors  in  the  present  and  three  previous  samples.  This 
V  scale  was  subsequently  subdivided  into  three  components:  (1)  The  V+,  or  rare  positive  response 
(RPR)  scale,  (2)  the  V-,  or  the  rare  negative  response  (RNR)  scale,  and  (3)  the  Vo,  or  rare  neutral 
response  scale.  The  V+  or  rare  positive  response  (RPR)  scale  finally  evolved  as  a  cuppressant- 
type  predictor  variable  in  the  multiple  regression  problem.  The  V-  scale  was  retained  as  a  veri¬ 
fication  scale,  and  the  Vo  was  dropped. 

Finally,  it  was  decided  to  adapt  the  L  scale  of  the  MMPI  for  use  as  another  verification 

scale. 


In  summary  the  verification  scales  and  number  of  items  in  each  are  as  follows: 

1.  The  L  scale  from  the  MMPI  --  15  items. 

2.  The  V-  or  RNR  scale  —  142  items. 
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3.  The  V+  or  RPR  scale  --  48  items. 

Use  of  the  verification  scales  will  be  discussed  in  a  subsequent  section. 

Keying  the  Inventory 

As  with  the  item  selection,  the  keying  of  the  items  w  s  done  by  joint  effort  of  the  consult¬ 
ants  on  the  project,  Drs.  Robert  Callis,  Kenneth  Brown,  John  Ferguson,  and  Guy  Renzaglia  and 
Mr.  Arthur  Krasner.  The  keying  of  each  item  was  on  a  judgmental  basis  where  the  consultants 
utilized  the  empirical  evidence  such  as  the  distribution  of  responses  on  this  study  in  terms  of 
item  difficulty,  and  discrimination  evidence  based  on  responses  to  items  now  in  the  NIAI  which 
had  been  part  of  the  previous  study  at  the  naval  school  (2).  Certain  items  were  discarded  when  it 
was  felt  that  the  evidence  was  not  sufficiently  clear  to  indicate  keying. 

Accordingly,  the  GA,  TA  and  PSE  scales  were  keyed  as  indicated  above,  where  any  one 
response  category  in  an  item  could  be  scored  either  plus  one,  minus  one,  or  zero,  depending  on 
the  empirical  evidence  and  the  agreement  of  the  consultants  after  taking  the  evidence  into  consi¬ 
deration. 

The  keying  for  the  V  scales,  which  were  based  on  frequency  of  response,  was  taken  direct¬ 
ly  from  keying  of  the  same  item  and  response  categories  on  the  content  scales  of  the  NIAI  which 
had  already  been  keyed.  After  this  was  done,  it  was  then  decided  to  break  the  V  scale  into  three 
components  as  mentioned  earlier.  This  was  done  to  see  how  many  of  the  item  response  catego¬ 
ries  were  keyed  as  plus  one,  as  minus  one,  and  as  zero.  The  V+  scale  thus  consisted  of  all  V 
items  keyed  as  plus  one,  the  V-  scale  of  all  items  keyed  as  minus  one  and  the  Vo  scale  of  all  items 
keyed  as  zero. 

The  L  scale  was  keyed  for  five  responses  instead  of  for  two  as  ir  the  MMPI.  This  results 
in  a  much  lower  mean  and  smaller  standard  deviation  in  the  NIAI  than  in  the  MMPI.  It  should  be 
noted  that  in  this  scale  the  ’esponse  categories  can  be  keyed  only  as  plus  one. 

Rationale  of  the  Use  of  the  Verification  Scales 

Experience  has  shown  that  most  examinees  are  conscientious  and  make  a  sincere  effort  to 
respond  to  examinations  as  directed.  However,  there  are  some  individuals  who  will  in  some  in¬ 
stances  deliberately  attempt  to  distort  test  results.  This  is  especially  likely  when  the  subjects 
are  coerced  into  taking  the  examinations,  and  even  more  so  if  the  tests  are  personality  or  attitude 
inventories. 

The  verification  scales  were  incorporated  in  the  NIAI  for  the  sole  purpose  of  detecting 
those  few  individuals  who  deliberately  try  to  distort  the  test  results.  It  is  conceivable  that  some 
individuals  will  rush  through  a  test  marking  Rems  without  reading  them.  Scores  for  such  test  be¬ 
havior  will  approximate  chance  scores.  Since  there  is  very  little  overlap  of  the  chance  and  real 
scores  in  either  Table  1  or  Table  2,  such  behavior  can  be  rather  definitely  identified. 

Another  possibility  would  be  for  a  subject  to  attempt  to  put  himself  in  a  very  bad  light  by 
marking  "negative"  attitude  responses  rarely  admitted  by  persons  conscientiously  marking  the 
test.  Such  behavior  would  result  in  a  very  high  V-  score,  approaching  or  exceeding  the  chance 
score  on  that  scale.  Unless  the  score  exceeded  chance,  there  would  be  no  way  of  distinguishing 
it  from  the  haphazard  marking  of  the  test  without  reading  the  items.  But,  it  would  make  little 
difference  which  it  is,  for  in  either  case  all  of  the  subject’s  scores  would  be  too  suspect  for  use 
and  should  be  declared  invalid  anyway. 

The  L  scale  of  the  NIAI  contains  the  same  items  as  the  L  scale  of  the  Minnesota  Multi- 
phasic  Personality  Inventory.  Thus,  it  can  be  interpreted  in  a  similar  manner  (5).*  A  high  score 


♦However,  since  five  alternatives  rather  than  two  were  used,  the  mean  and  standard  deviation  of 
the  L  scores  here  are  lower  than  on  the  MMPI. 
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on  the  L  scale  indicates  haphazard  answering  of  the  items,  perhaps  without  reading,  or  the  claim  to 
righteous  attitudes  which  are  extremely  rare  among  normal  people  conscientiously  responding  to 
the  inventory. 


TABLE  1 

NAVY  INSTRUCTOR  ATTITUDE  INVENTORY:  L  SCALE 
REAL  AND  CHANCE  SCORES 


RS 

Real  1 

Chance 

Centile 

f 

Centile 

9 

1 

100. 

8 

1 

98.7 

50.0* 

7* 

0 

97.2 

41.3 

6 

1 

97.2 

22.0 

5 

1 

95.8 

9.1 

4 

4 

94.4 

3.0 

3 

5 

88.7 

0.8 

2 

15 

81.5 

1 

20 

60.1 

0 

22 

31.5 

*The  chance  mean  is  7.4;  the  S.  D.  is  1.81.  The  distribution  is  based  on  probability  calculations. 


TABLE  2 

NAVY  INSTRUCTOR  ATTITUDE  INVENTORY: 
RARE  NEGATIVE  RESPONSE  (V-)  SCALE 
REAL  AND  CHANCE  SCORES 


RS 

Real 

Chance 

Centile 

f 

Centile 

48-50* 

0 

50.0* 

45-47 

1 

100. 

41.0 

42-44 

0 

98.7 

21.4 

39-41 

0 

98.7 

8.7 

36-38 

l  0 

98.7 

k-  •* 

L  2.7 

21-23 

1  1 

98.7  I 

18-20 

4 

97.2 

15-17 

5 

91.5 

12-14 

6 

84.4 

9-11 

13 

75.8 

6-  8 

14 

57.2 

3-  5 

17 

37.2 

0-  2 

9 

12.9 

*The  chance  mean  is  48.2;  the  S.  D.  is  5.29.  The  distribution  is  based  on  probability  calculations. 


Thus,  it  is  suggested  that  the  testing  be  declared  invalid  for  individuals  who  have  raw 
scores  higher  than  three  on  the  L  scale  or  higher  than  20  on  the  V-  scale. 

The  V+  scale  was  originally  a  verification  scale  too,  but  from  the  regression  analysis  it 
was  found  to  be  a  good  predictor  variable.  Its  function  as  a  predictor  seems  to  be  that  of  a 


“suppressant"  (7).*  On  the  V+  scale  a  cutting  score  of  eight  (two  standard  deviations  high)  can  be 
used  to  indicate  invalid  answering  of  the  inventory. 

The  Variables  and  the  Correlation  Matrix 


The  six  variables  of  the  NIAI  (excluding  the  L  scale)  were  to  be  used  as  independent  vari¬ 
ables  in  a  multiple  regression  problem  for  predicting  the  combined  criterion.  The  six  NIAI  inde¬ 
pendent  variables  were:  TA,  GA,  PSE,  and  the  three  V  scales.  The  dependent  variable,  combined 
criterion,  was  the  sum  of  standard  scores  obtained  from  the  ratings  made  by  the  educational 
specialist  and  the  mean  of  student  ratings  for  each  instructor. 

Ten  additional  variables  of  secondary  importance  were  included  to  produce  a  16  x  16  cor¬ 
relation  matrix  (Table  3).  These  ten  variables  are  of  interest  as  aids  to  interpreting  the  six  pri¬ 
mary  variables  and  the  criteria.  Attention  is  called  to  the  fact  that  in  Table  3  some  of  the  data 
are  incomplete,  e.g..  Arithmetic  Test  Scores  v  ere  available  for  only  34  of  the  70  subjects.  The 
16  variables  of  Table  3  are  as  follows: 

1.  The  Criterion  of  the  multiple  regression  problem.  This  variable  was  obtained  by  sum¬ 
ming  the  standard  scores  for  each  individual  on  the  educational  specialist’s  ratings  and 
the  mean  of  students'  ratings.  (N  =  70) 

2.  Teacher  Attitude  (TA)  Scale,  (N  =  70)  (r^  =  .75)** 

3.  General  Adjustment  (GA)  Scale,  (N  =  70)  (rjj  =  .81) 

4.  Past  School  Experience  (PSE)  Scale,  (N  =  70).  (rjj  =  .91) 

5.  V  Plus  (V+)  Scale,  (N  =  70)  (ru  =  .82) 

6.  V  Minus  (V-)  Scale,  (N  =  70)  (rn  =  .86) 

7.  V  Zero  (Vo)  Scale,  (N  =  70)  (rg  =  .84) 

8.  L  Scale  from  the  MMPI  (N  =  70)  (rjj  =  .53) 

9.  Educational  Specialist's  Ratings  of  instructors  expressed  in  standard  scores  (N  =  70). 
This  is  one  of  the  two  components  of  the  criterion  (variable  No.  1). 

10.  Student  Ratings  of  instructors  expressed  in  standard  scores  (N  =  70).  This  is  the  other 
component  of  the  criterion  variable. 

11.  General  Classification  Test  (GCT)  Scores  (N  =  68) 

12.  Mechanical  Aptitude  Test  Scores  (N  =  67) 

13.  Arithmetic  Test  Scores  (N  =  34) 

14.  Age  of  the  Instructors  (N  =  69) 


*If  in  a  prediction  battery  of  tests,  one  separate  named  test  is  a  "suppressant”,  sometimes  stu¬ 
dents  learn  of  this  one  test  which  received  a  negative  weight  and  deliberately  try  to  make  very 
poor  scores  on  that  one  test.  Since  the  V+  of  the  NIAI  is  not  a  separate  test  which  examinees  can 
identify,  there  is  no  such  danger  in  using  it  here. 

**A11  reliability  coefficients  reported  here  were  estimated  by  the  Rulon  split-half  technique  (8). 
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CORRELATION  MATRIX* 


if).  Years  of  Schooling  (N  =  69) 

16.  Months  on  Staff  of  the  Airman  School  (N  =  68) 

It  may  be  of  interest  to  note  that  none  of  the  variables  outside  of  the  N1A1  group  correlate 
higher  than  0.20  with  the  criterion  except  the  Arithmetic  Test  Scores.  It  will  be  recalled  that  the 
number  of  cases  for  which  Arithmetic  Test  Scores  were  available  was  only  34;  hence,  the  coeffi¬ 
cient  of  0.25  between  the  criterion  and  Arithmetic  Test  Scores  is  not  significant  at  the  5%  level  of 
confidence.  It  is  of  special  interest  that  neither  the  criterion  nor  any  of  the  NIAI  variables  seem 
to  be  very  much  related  to  the  GCT  scores  or  any  of  the  other  aptitude  measures  (with  the  possible 
exception  of  the  Arithmetic  Test  Scores  just  mentioned). 

Two  of  the  NIAI  variables  fall  short  of  5%  level  of  confidence  correlations  with  the  crite¬ 
rion  (GA  and  V+).  Only  one  of  the  six  NIAI  variables  (V-)  has  a  correlation  coefficient  with  the 
criterion  which  is  significant  at  the  1%  level. 


ANALYSIS  --  Part  1 


The  Multiple  Regression  Problem 

With  an  N  of  only  70,  with  criterion  correlations  of  doubtful  significance,  and  with  the  inter- 
correlations  of  the  independent  variables  relatively  high  in  most  instances,  it  was  with  reservation 
that  a  multiple  regression  problem  was  attempted.  However,  since  there  seemed  an  outside  chance 
that  the  work  might  at  least  be  indicative  of  what  could  be  expected  from  a  larger  sample,  the 
problem  was  attempted. 

As  previously  stated,  the  six  scales  of  the  NIAI  were  the  independent  variables  for  pre¬ 
dicting  the  combined  ratings  criterion.  With  these  six  variables  a  multiple  R  of  0.383,  which  is 
just  short  of  significance  at  the  5%  level,  was  obtained.  Significance  tests  of  the  betas  for  each  of 
the  six  variables  revealed  two  variables,  Vo  and  V-,  which  were  contributing  very  little  to  the  mul¬ 
tiple  correlation.  Hence,  it  was  decided  to  repeat  the  problem  using  only  four  independent  variables, 

TABLE  4 


THE  BETA  COEFFICIENTS  FOR  THE  SIX  VARIABLES 


Variables 

TA 

GA 

PSE 

V+ 

V- 

Vo 

Betas 

.181 

.112 

.168 

-.177 

.043 

-.091 

TA,  GA,  PSE  and  V+.  This  produced  a  multiple  correlation  of  0.379,  for  which  the  level  of  signifi¬ 
cance  is  between  the  one  and  five  per  cent  levels. 

TABLE  5 

DATA  ON  THE  MULTIPLE  REGRESSION  PROBLEM 


Variables 

TA 

GA 

PSE 

V+ 

Criterion 

|[  X 

s 

TA 

1.0000 

.3068 

.3584 

.1541 

.2456 

8  4 

10 

.0450 

GA 

.3068 

1.0000 

.6468 

.2624 

.2288 

3  9 

n 

.0289 

PSE 

.3584 

.6468 

1.0000 

.2258 

.2588 

8  16 

10 

.0418 

V+ 

.1541 

.2624 

.2258 

1.0000 

-.1243 

1  2 

3 

.0276 

Betas 

.183 

.126 

.162 

-.222 

N  =70 

.236 

R2 

=  .1433 
=  .379 

r.05  ' 

R 

b 

.247 

.154 

.202 

-.953 

r.01  = 

.306 

,05>p>  .01 
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Fable  5  presents  the  eorrelation  matrix  with  the  coefficients  carried  to  four  places.  The 
beta  multiplications  which,  when  summed,  yield  R“  are  given;  each  product  shows  the  proportion 
of  accounted-for  variance  the  respective  variable  contributes.  The  unrounded  b-coefficients,  re¬ 
gression  indices,  are  presented  for  the  reader  who  might  be  concerned  with  how  much  influence 
the  rounding  may  have  had  on  the  formula  for  obtaining  weighted  total  scores  which  arc  discussed 
subsequently. 

Interpretation 


The  standard  error  of  estimate  for  the  prediction  equation  is  12.03.  The  error  of  estimate 
is  large  in  relation  to  the  standard  deviation  of  the  criterion.  The  forecasting  efficiency  is  only 
about  7.5%.  Also,  because  of  the  small  sample  used,  the  expected  “shrinkage"  is  great.  After 
“shrinkage”  the  coefficient  is  estimated  to  be  about  0.30. 

The  reliability  of  the  criterion  is  unknown,  but  surely  it  is  much  lower  than  for  any  of  the 
NIAI  predictor  scales.  However,  since  the  reliability  of  the  criterion  is  not  known,  the  unreliability 
of  the  criterion  cannot  be  safely  blamed  for  producing  a  low  multiple  correlation  coefficient. 

Suggestions  for  Application 

Until  another  more  conclusive  validation  study  on  the  NIAI  is  done,  applications  of  the  in¬ 
strument  should  be  limited  to  experimental  programs.  Obviously,  many  other  factors  should  be 
considered  when  selecting  instructors  for  Navy  AN  (P)  Schools.  However,  with  all  other  considera¬ 
tions  equal,  instructor  candidates  with  high-weighted  total  scores  on  the  NIAI  (subsequently  defined) 
should  be  preferred  to  those  with  low-weighted  total  scores.  An  alternate  approach  to  the  study 
and  application  of  the  NIAI  which  seems  to  hold  good  promise  will  be  the  topic  of  the  second  part 
of  this  analysis  and  will  be  presented  subsequently. 

The  NIAI  Profile  Sheet 


Table  6  summarizes  a  very  large  portion  of  the  data  available  on  the  NIAI.  In  fact,  since 
the  NIAI  Profile  Sheet  is  not  being  recommended  for  other  than  experimental  application,  it  is  for 
this  purpose  of  summarizing  the  data  that  it  is  presented  here. 

Reading  from  left  to  right  across  the  top  of  Table  6  are  the  NIAI  Scales:  L;  V-;  V+;  Teacher 
Attitude  (TA);  General  Adjustment  (GA);  Past  School  Experience  (PSE);  and  the  Weighted  Total. 

The  columns  at  either  side  of  the  Profile  Sheet  are  scaled  for  Z-scores.*  Each  scale  of 
the  NIAI  was  converted  to  Z-scores  and  plotted  on  the  Profile  Sheet.  Thus,  the  Profile  Sheet  serves 
as  both  a  table  of  normative  data  and  a  conversion  table  for  each  of  the  NIAI  scales.  The  raw 
scores  for  each  scale  appear  in  the  column  under  the  name  of  the  scale,  however  for  TA,  GA,  and 
PSE,  50  points  have  been  added  to  each  raw  score.  The  Z-score  conversion  is  made  by  first  find¬ 
ing  the  particular  raw  score  to  be  converted,  adding  50  to  the  raw  score,  and  moving  either  to  the 
left  or  to  the  right  margin  of  the  Profile  Sheet  and  reading  the  value  at  that  height  in  the  Z-scale 
column.  For  example,  suppose  one  wanted  to  convert  a  GA  raw  score  of  30  to  a  standard  Z-score. 
First  add  50  to  the  raw  score  of  30,  then  looking  in  the  column  of  GA  scores  find  the  score  of  80. 
Moving  directly  across  the  sheet  to  the  margin  one  finds  a  70  at  the  same  height  on  the  profile 
in  the  Z-score  column.  Thus,  for  a  GA  raw  score  of  30,  the  corresponding  Z-score  is  70. 

The  NIAI  Weighted  Total  Score  represents  the  best  combination  of  the  four  predictors  for 
predicting  the  criteria  used  in  this  study  (See  Table  5).  It  is  found  by  the  following  formula: 

.25  TA  +  .15  GA  +  .20  PSE  -  (V+)  +  66  =  The  Weighted  Total  Score. 

The  raw  scores  of  the  predictors  as  they  appear  on  the  profile,  are  used  in  the  formula.  These 
Weighted  Total  Scores  are  also  plotted  on  the  profile. 


*Z  =  10z  +  50.  Z  =  50.  sz  =  10. 
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ANALYSIS  Part  II 


The  Classification  Problem 


An  alternate  approach  to  application  of  the  NIAI  would  be  to  shift  the  emphasis  from  mea¬ 
surement  and  prediction  along  a  continuum  to  that  of  classification  of  a  designated  proportion  of 
the  available  pool  of  instructors  into  a  dichotomy  of  acceptable  and  unacceptable  applicants.  This 
phase  of  the  analysis  focuses  upon  investigation  of  the  potentialities  of  the  NIAI  as  a  selection  de¬ 
vice  when  used  in  conjunction  with  a  classification  equation  (discriminant  function).  When  the 
same  criterion  is  used  and  only  two  criterion  groups  are  involved,  the  discriminant  functions  and 
multiple  regression  equations  may  be  expected  to  yield  approximately  the  same  results  (9).  In 
this  special  case  discriminant  scores  may  be  used  to  rank  individuals  according  to  the  estimate  of 
the  degree  of  success  each  will  attain  on  the  job.  And,  predicted  scores  from  a  multiple  regression 
equation  may  be  used  to  classify  individuals  into  either  of  two  groups  by  use  of  a  cutting  score. 
Thus,  in  the  special  case  of  two  groups,  choice  of  the  two  methods  may  devolve  to  practical  matters 
of  flexibility  and  amenability  to  the  kinds  of  criteria  available. 

Discriminant  analysis  permits  the  use  of  criteria  not  readily  amenable  to  multiple  re¬ 
gression  work.  Also,  discriminant  analysis,  as  a  working  technique,  is  highly  flexible  in  that 
several  combinations  of  criteria  can  be  tried  with  a  minimum  of  additional  labor.  This  follows 
from  the  fact  that  once  the  reciprocal  dispersion  matrix  is  found,  all  that  is  needed  for  obtaining 
different  classification  equations  are  the  different  sets  of  differences  between  means  for  the  dif¬ 
ferently  defined  criterion  groups.  Changes  in  the  criterion  definition  when  doing  multiple  re¬ 
gression  problems  requires  new  sets  of  correlation  coefficients  which  are  much  more  laborious 
to  obtain  than  the  mere  differences  between  pairs  of  means. 

Thus,  the  classification  problem  suggested  here  is  to  find  a  suitable  classification  equation 
for  use  with  NIAI  scores  making  the  NIAI  a  selection  device  in  which  a  decision  to  accept  or  reject 
an  applicant  would  be  made  on  the  basis  of  whether  or  not  the  discriminant  score  for  the  applicant 
exceeds  a  certain  value.*  Some  classification  results  using  multiple  regression  will  be  presented 
to  demonstrate  the  comparability  of  the  technique  to  discriminant  functions  with  two  groups  and 
identical  criteria.  Some  special  advantages  of  discriminatory  analyses  will  be  discussed. 

Multiple  Regression  Data  and  Classification 

By  application  of  the  multiple  regression  equation  presented  in  the  Analysis,  Part  I,  to  the 
70  cases  of  this  study,  the  weighted  total  scores  (predicted  criterion  scores)  for  each  of  the  70  in¬ 
structors  are  found.  By  selecting  the  median  predicted  score  (100.05)  as  a  cutting  point  the  70 
cases  can  be  divided  into  halves.  Then,  selecting  the  upper  half,  a  count  can  be  made  to  determine 
what  percentage  of  these  cases  which  were  above  the  median  predicted  score  are  also  above  the 
median  criterion  rating.  This  percentage  may  be  taken  as  the  percentage  of  correct  classifica¬ 
tion,  which  is  66%  for  these  data.  Setting  the  cutting  point  is  arbitrary.  In  this  case  it  was  set  to 
select  one  of  every  two  applicants  available.  Any  other  point  could  be  chosen.  For  example,  if 
the  top  one-third  of  this  sample  is  chosen  on  the  basis  of  predicted  criterion  scores,  using  the 
score  of  102.4  as  the  cutting  point,  74%  of  this  top  one-third  is  found  also  to  exceed  the  median 
on  the  combined  criterion.  In  the  analyses  which  follow  it  will  be  shown  that  even  this  percentage 
of  correct  classification  can  be  exceeded. 

First  Classification  Equation 

This  first  attempt  using  the  linear  discriminant  function  was  chosen  to  simulate  the  condi¬ 
tions  of  classification  by  use  of  multiple  regression  data.  In  theory,  the  results  should  be  approxi¬ 
mately  the  same,  and  as  depicted  in  Table  8,  the  results  are  very  much  the  same. 


*This  is  in  no  way  to  preclude  the  application  of  other  criteria  when  selecting  instructors. 
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The  first  classification  equation*  or  discriminant  function  is  as  follows: 

.806  TA  +  1.000  GA  +  .836  PSE  -  1.736  V+  =  Discriminant  Score  I. 

All  seven  test  scores  and  the  three  criterion  scores  for  each  individual  were  put  on  3"  x 
5"  cards.  The  70  cards  were  sorted  into  two  equal  piles.  One  pile  was  comprised  of  all  individuals 
whose  combined  criterion  ratings  were  above  the  median;  the  other  pile  was  comprised  of  all  those 
below  the  median  combined  criterion  rating.  Hereinafter,  those  35  cards  for  individuals  whose 
combined  ratings  were  higher  than  the  median  will  be  called  the  Upper  35  Group;  the  35  cards  for 
the  remainder  will  be  called  the  Lower  35  Group. 

The  means  on  the  four  variables  (TA,  GA,  PSE,  and  V+)  for  the  Upper  35  Group  and  for  the 
Lower  35  Group  were  run  through  the  classification  equation  to  obtain  group  discriminant  scores. 
The  arithmetic  mean  of  the  two  group  discriminant  scores  was  computed  and  used  as  the  cutting 
score  for  classifying  individuals  into  either  the  Upper  35  Group  or  the  Lower  35  Group.  Then,  the 
70  cards,  one  for  each  instructor  in  the  sample,  were  used  to  obtain  discriminant  scores  for  each 
individual  and  hence  to  classify  them  into  the  two  groups.  Table  7  summarizes  the  data  of  this 
paragraph.  It  is  noted  that  the  overall  percentage  of  correct  classification  is  66,  the  same  as  was 

TABLE  7 

EXPECTANCY  TABLE  FOR  FIRST  CLASSIFICATION  EQUATION 


Discriminant 

Criterion  ! 

Correct 

Score 

Below  Median 

Above  Median 

Classification 

Over  153.34 

14 

25 

64% 

Below  153.34 

21 

10 

68% 

Correct 

Classification 

60% 

71% 

Total  66% 

obtained  using  a  prediction  index  with  the  multiple  regression  equation.  However,  it  appears  that 
the  cutting  score  is  too  low,  resulting  in  39  being  selected  and  only  31  rejected.  If  the  cutting 
score  is  adjusted  upward  to  the  median  for  the  70  cases,  the  expectancy  table  becomes  balanced, 
exactly  as  it  was  with  multiple  regression  (See  Table  8). 

TABLE  8 

ADJUSTED  EXPECTANCY  TABLE  FOR  FIRST  CLASSIFICATION  EQUATION 


Discriminant 

Criterion  ! 

Correct 

Score 

Below  Median 

Above  Median 

Classification 

Over  Median 

12 

23 

66% 

Below  Median 

23 

12 

66% 

Correct 

Classification 

66% 

66% 

Total  66% 

Multiple  Regression  and  the  Purified  Criterion 

In  the  previous  discussion  of  the  verification  scales  it  was  stated  that  according  to  the  cri¬ 
teria  recommended  here  for  declaring  certain  cases  invalid,  some  of  the  cases  used  in  this  study 


*The  first  classification  equation  was  computed  by  using  the  inverse  of  the  intercorrelation  matrix, 
first  dividing  the  differences  between  means  by  their  respective  roots  of  the  sums  of  the  squared 
deviations  (vEx2).  Then  the  solutions  to  the  equations  were  again  divided  by  respective  roots  of 
sums  of  squared  deviations  (V Ex'*)  to  obtain  discriminant  function  coefficients  (4).  One  of  these  co¬ 
efficients  (GA)  was  set  to  equal  unity  ana  all  the  others  changed  to  maintain  proportionality.  It  should 
be  noted  that  the  inverse  matrix  and  all  the  basic  data  used  were  available  from  the  regression 
analysis. 
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should  be  ejected  from  the  study  for  invalid  testing.  The  criteria  were  applied  and  six  cases  were 
declared  invalid.  Three  of  the  six  were  rated  above  the  median  combined  criterion  rating  and 
three  were  rated  below.  As  hypothesized,  both  the  prediction  equation  and  the  classification  equa¬ 
tion  did  poorly  with  these  six  cases.  Hence,  it  is  assumed  that  inclusion  of  these  six  cases  actually 
contaminated  the  sample,  that  to  remove  them  would,  in  effect  and  to  some  degree,  purify  the  cri¬ 
terion.  But  these  six  could  not  be  identified  until  after  the  scores  were  processed  so  they  were  re¬ 
tained  in  the  major  body  of  the  study.  Now  the  six  cases  are  being  removed  and  certain  parts  of 
the  study  repeated  to  see  what  influences  these  invalid  cases  had  on  the  results. 

Also,  it  was  noted  that  the  V+  distribution  was  severely  skewed,  that  a  large  portion  of  the 
variation  was  resulting  from  a  very  small  portion  of  the  sample  so  the  V+  variable,  except  as  a 
verification  scale,  is  dropped  from  the  study  at  this  point. 

Another  regression  analysis  was  made  using  the  three  variables  (TA,  GA,  and  PSE,  pre¬ 
dicting  combined  criterion)  and  the  64  remaining  cases.  The  multiple  regression  equation  is  as 
follows: 

.31  TA  +  .02  GA  +  .26  PSE  +  65  =  Second  Weighted  Total  Score. 

Table  9  summarizes  the  results. 


TABLE  9 

DATA  ON  SECOND  MULTIPLE  REGRESSION  PROBLEM 


Variables 

TA 

GA 

PSE 

Criterion 

0rc 

TA 

1.0000 

.3065 

.2951 

.0690 

GA 

.3065 

1.0000 

.1958 

.0034 

PSE 

.2993 

.5716 

1.0000 

.2666 

.0497 

Betas 

.234 

.017 

"  .187 

N  =  64  I 

12  =  .1221 

~  -  OvtQ  D  -  OC 

|A  UO  i 

b 

.311 

.022 

.263 

r  oi  =  -316  .05>p> .01 

Then,  following  the  same  procedure  as  before  in  utilizing  multiple  regression  data  for 
classification,  the  overall  assignment  to  groups  was  found  to  classify  69%  correctly.  Table  10  is 
the  four-fold  expectancy  table  for  these  data. 

TABLE  10 

EXPECTANCY  TABLE  FOR  SECOND  MULTIPLE  REGRESSION  EQUATION 


Predicted 

Criterion  j 

Correct 

Score 

Below  Median 

Above  Median 

Over  101.6 

10 

22 

Below  101.6 

22 

10 

69% 

Correct 

Classification 

69% 

69% 

Total  69% 

The  Second  Classification  Equation 

Again,  the  multiple  regression  data  were  employed  to  obtain  another  classification  equa¬ 
tion  for  the  three  variables  and  64  cases.  However,  correlation  coefficients  were  not  used;  thetas 
(Ex2’s  and  Zxy’s)  were  used  instead.  The  reciprocal  theta  matrix  was  obtained  and  used  for  this 
and  all  the  following  discriminant  equations.  The  advantage  of  using  the  theta  matrix  derives 
from  the  fact  that  differences  in  means  may  be  used  directly  without  having  to  make  adjustments 
with  respective  roots  of  sums  of  deviations  (VTx2). 
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The  following  classification  equation  was  obtained: 

1.00  TA  +  .558  GA  +  .336  PSE  "  Discriminant  Score  II. 

Application  of  the  equation  produced  the  results  portrayed  in  Table  11. 

TABLE  11 

EXPECTANCY  TABLE  FOR  SECOND  CLASSIFICATION  EQUATION 


Discriminant 

Criterion  | 

Correct 

Score 

Below  Median 

Above  Median 

Classification 

Over  109.31 

11 

24 

69% 

Below  109.31 

21 

8 

72% 

Correct 

Classification 

66% 

75% 

Total  70% 

Tables  10  and  11  may  be  compared.  Overall,  there  is  not  much  to  choose  between  them. 
The  discriminant  function  seems  to  do  a  better  job  in  classifying  individuals  who  are  rated  above 
the  median  than  it  does  in  classifying  those  rated  below  the  median  on  the  criterion.  No  credence, 
except  to  note  as  a  possible  trend,  should  be  awarded  this  difference  because  with  this  small  sam¬ 
ple  the  difference  is  not  statistically  significant. 

The  Third  Classification  Equation 

Without  removing  either  variables  or  cases  and  without  having  to  use  a  different  inverse 
matrix,  another  device  for  improving  the  criterion  would  be  to  apply  the  Kelley  split  (6).  Since 
the  criterion  is  a  single  continuous  variable,  the  scheme  is  to  rank  all  cases  on  the  criterion  and 
to  select  the  upper  and  lower  27%  divisions  of  the  group  for  contrasting.  This  is  the  technique 
commonly  used  in  item  analysis  work  and  there  seems  to  be  no  evidence  that  it  would  not  be  appli¬ 
cable  here.  This  was  done  on  the  64  cases,  yielding  two  groups  of  17  cases  each.  Their  differ¬ 
ences  in  means  were  run  through  the  reciprocal  theta  matrix  and  the  following  discriminant  equa¬ 
tion  obtained: 

1.000  TA  +  .286  GA  +  .891  PSE  =  Discriminant  Score  III. 

Applying  the  above  equation  to  all  64  cases  the  results  of  Table  12  evolved. 

TABLE  12 

EXPECTANCY  TABLE  FOR  THIRD  CLASSIFICATION  EQUATION 


Discriminant 

Criterion  I 

Correct 

Score 

Below  Median 

Above  Median 

Classification 

Over  129.17 

12 

26 

68% 

Below  129.17 

20 

6 

77% 

Correct 

Classification 

62% 

81% 

Total  72% 

Again  it  is  noted  that  the  discriminant  function  did  a  better  job  with  those  rated  above 
than  with  those  rated  below  the  combined  criterion.  The  trend  is  stronger  than  before  but  still 
short  of  statistical  significance.  With  just  the  34  cases  of  the  two  criterion  groups  this  trend  was 
still  stronger  and  the  overall  correct  classification  was  79%.  The  correct  classification  for  those 
scoring  above  the  median  was  88%. 

The  Fourth  Classification  Equation 

One  other  attempt  was  made  to  purify  the  criterion  on  the  same  three  variables,  the  same 
64  cases,  and  the  same  inverse  theta  matrix.  The  rationale  for  this  was  that  rather  than  use  the 
combined  criterion  as  such,  individuals  would  be  selected  who  were  above  the  median  on  both  the 


student  and  educational  specialist’s  ratings  to  be  contrasted  to  those  who  were  below  the  median 
on  both  criteria.  This  resulted  in  two  groups  of  13  cases  each.  The  classification  equation  result¬ 
ing  from  this  arrangement  was  as  follows: 

1.000  TA  +  .719  GA  +  .669  PSE  =  Discriminant  Score  IV. 

Application  of  the  equation  to  the  64  cases  yielded  a  table  with  expectancies  exactly  the 
same  as  those  in  Table  12,  hence  the  table  is  not  presented.  A  check  was  made  to  determine 
whether  or  not  the  same  cases  comprised  the  two  tables.  It  was  found  that  four  cases  of  the  64 
were  switched  --  two  up  and  two  down. 

The  overall  correct  classification  for  the  26  cases  of  the  criterion  groups  was  85%.  The 
table  was  perfectly  balanced;  2  and  11,  11  and  2. 

Interpretation 

Specific  interpretation  has  accompanied  the  presentation  of  each  classification  equation. 

By  way  of  general  interpretation  it  appears  that  the  discriminant  functions  used  tended  to 
do  a  better  job  classifying  individuals  rated  above  the  criterion  median  than  classifying  those  be¬ 
low  the  median.  This  is  interpreted  to  indicate  that  the  higher -rated  instructors  are  a  more 
homogeneous  lot  than  the  lower-rated  instructors.  That  is  to  say,  there  are  fewer  ways  to  be  an 
effective  instructor  than  ways  to  be  an  ineffective  instructor  --  effective  in  the  sense  of  ability 
to  promote  desirable  harmonious  interpersonal  relationships  in  the  classroom.  There  is  no  con¬ 
clusive  evidence  for  this,  so  it  must  be  regarded  as  a  hypothesis. 

Suggestions  for  Application 

The  suggestion  that  the  use  of  the  NIAI  be  restricted  to  experimental  programs  still 
stands.  Since  the  sample  used  here  was  quite  small,  and  since  all  validation  was  mere  verifica¬ 
tion  applying  the  equations  back  on  the  same  individuals  from  which  the  equations  were  developed, 
it  might  be  foolhardy  to  place  much  confidence  in  these  equations  until  they  have  been  cross-vali¬ 
dated  or  found  to  function  well  in  an  experimental  program.  However,  if  upon  cross-validation  it 
was  found  that  the  better  equations  were  even  half  as  effective  as  with  this  sample,  use  of  the 
NIAI  as  a  screening  device  might  prove  practical. 

If  the  NIAI  and  these  equations  are  considered  for  use,  it  is  recommended  that  the  second, 
third,  and  fourth  classification  equations  (all  three)  be  used.  Then,  if  the  present  means  of  selec¬ 
tion- were  continued  long  enough  and  a  sample  of  100  or  so  new  cases  accrued,  similar  ratings 
could  be  applied  and  the  equations  cross-validated. 

With  a  continuous  criterion  and  the  two- group  discriminant  function,  setting  the  cutting 
point  on  the  discriminant  score  is  arbitrary.  The  arithmetic  mean  of  the  two  group  discriminant 
scores  was  used  here.  For  example,  if,  on  the  basis  of  discriminant  scores,  the  top  one-third  had 
been  selected,  90%  of  those  so  selected  would  have  been  found  to  have  combined  criterion  ratings 
above  the  median  rating.  Thus,  if  there  were  three  persons  to  choose  from  each  time  one  instruc¬ 
ts  was  needed,  using  either  equation  HI  or  IV,  90%  of  those  selected  would  earn  ratings  equivalent 
to  those  earned  by  the  upper  half  of  this  sample.  (This  actually  assumes  too  much.  It  assumes 
perfect  sampling  and  no  loss  in  classification  effectiveness  upon  cross-validation.)  However,  this 
percentage  (90%)  appears  superior  to  that  for  the  regression  equation  (74%). 

In  actual  practice,  use  of  the  classification  equations  can  be  speeded  up  by  rounding  down 
to  about  one  digit  in  each  term.  If  a  discriminant  score  comes  close  to  the  cutting  score,  then  in 
the  special  case  the  full  three  digit  terms  can  be  used  to  obtain  the  exact  decision  determined  by 
the  equation.* 


*For  example,  equation  IH  may  be  used  as  TA  +  .3  GA  +  .9  PSE  =  Discriminant  Score  IH. 


It  is  suggested  that  when  the  NIAI  is  used  the  verification  scales  be  scored  and  used  to 
eliminate  severe  cases  of  invalid  testing  before  applying  classification  equations. 

CONCLUSIONS  AND  SUGGESTIONS  FOR 
FURTHER  RESEARCH 

It  may  be  concluded  that  the  NIAI  holds  promise  of  being  highly  useful  in  selecting  instruc¬ 
tors  for  Naval  Air  Technical  Training  Schools  or  in  identifying  instructors  who  may  need  more 
supervisory  help  than  others.  Its  best  application  seems  to  lie  in  its  use  as  a  selection  device  in 
conjunction  with  a  classification  equation. 

Another  suggestion  for  further  research  follows  from  the  fact  that  the  validity  investigated 
here  is  descriptive  and  concurrent  rather  than  prognostic  or  predictive.  Descriptive  validity  is 
logically  conceived  as  a  necessary  but  not  sufficient  condition  for  the  instrument  to  have  predic¬ 
tive  validity.  Thus,  to  demonstrate  predictive  validity  further  research  would  be  necessary  in 
which  testing  was  done  at  the  time  of  selection  and  the  criterion  ratings  procured  and  used  some¬ 
time  later  after  the  instructors  have  had  sufficient  time  to  establish  the  kind  of  classroom  rela¬ 
tionships  which  typify  their  teaching  and  after  those  who  make  the  ratings  have  had  sufficient  time 
to  do  so  from  knowledge  necessary  for  reliable  criterion  data. 

The  primary  suggestion  for  further  research  has  already  been  stated,  i.e.,  obtain  a  cross- 
validation  on  the  instrument  and  the  equations.  In  consideration  of  the  equations  developed  here, 
the  criterion  of  the  cross-validation  should  be  a  replication  of  the  criterion  used  here.  However, 
if  a  new  criterion  is  considered  it  is  strongly  suggested  that  naval  personnel  be  consulted  exten¬ 
sively  in  its  definition.  With  a  new  criterion  new  classification  equations  would  have  to  be  derived. 

SUMMARY 

An  instrument  herein  called  the  Navy  Instructor  Attitude  Inventory  (NIAI)  was  constructed. 
The  basis  for  and  the  procedures  followed  in  this  construction  have  been  cited  or  described. 

A  validation  study  of  the  NIAI  was  attempted  using  a  limited  sample  of  70  instructors  and 
an  externally  defined  criterion.  The  seven  variables  of  the  NIAI  and  nine  others  were  intercorre- 
lated  to  observe  the  relationships  of  these  variables.  Six  of  the  NIAI  variables  were  used  in  a 
multiple  regression  problem,  resulting  in  a  multiple  correlation  coefficient  (R  =  0.383)  which  did 
not  quite  attain  significance  at  the  five  per  cent  level  of  confidence.  For  this,  the  standard  error 
or  estimate  was  12.03;  the  forecasting  efficiency  only  about  7.5%  better  than  chance.  This  multiple 
correlation  coefficient  corrected  for  "shrinkage”  dropped  to  0.30. 

A  prediction  equation  using  the  three  NIAI  content  scales  and  one  verification  scale  (Rare 
Positive  Response  or  V+  which  appeared  to  function  as  a  “suppressant”)  was  established.  Also,  a 
Profile  Sheet  summarizing  the  normative  data,  giving  Z -score  conversions  and  a  distribution  of 
the  Weighted  Total  Scores  (predicted  criterion  scores)  was  presented. 

It  was  suggested  that  use  of  the  NIAI  be  limited  to  experimental  programs. 

Some  rationale  was  given  for  shifting  the  emphasis  from  predicting  a  specific  criterion 
score  to  classifying  with  respect  to  a  decision  for  accepting  or  rejecting  an  applicant.  Use  of  the 
NIAI  was  thus  envisioned  as  providing  an  additional  screening  device  to  be  used  in  selecting  new 
instructors  or  retaining  experienced  ones. 

Four  classification  equations  were  developed  and  briefly  interpreted.  The  first  was  de¬ 
signed  to  simulate  as  closely  as  possible  the  situation  of  multiple  regression  analysis  already  pre¬ 
sented.  The  second  was  similar  to  the  first,  also  contrasted  to  another  multiple  regression  analy¬ 
sis,  but  using  one  less  variable.  Also,  six  cases  were  rejected  because  of  invalid  testing  and 
dropped  from  the  study.  The  third  and  fourth  classification  equations  were  based  on  further  at¬ 
tempts  to  purify  the  criterion,  viz,  using  the  Kelley  split  and  selecting  criterion  groups  on  basis 
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of  consistent  ratings.  Classification  improved  with  the  development  of  each  equation,  except  the 
last  in  which  classification  was  identical  to  that  just  before  it.  It  was  noted  that  the  classification 
equations  tend  to  be  more  successful  with  instructors  above  the  median  than  with  those  below  the 
median  criterion  rating.  This  was  interpreted  by  the  hypothesis  that  perhaps  good  instructors  are 
mere  homogeneous  than  poor  ones. 

Some  suggestions  for  the  use  of  the  NIAI  and  some  of  the  classification  equations  were 
proffered.  It  was  strongly  suggested  that  a  cross-validation  be  done  before  too  much  confidence 
is  placed  upon  thp  instrument  or  any  of  its  appended  equations. 
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APPENDIX  A 


DO  NOT  OPEN  UNTIL  TOLD  TO  DO  SO 


NAVY  INSTRUCTOR  ATTITUDE 
INVENTORY 

Form  NX-1 


DIRECTIONS 

This  inventory  consists  of  statements  designed  to  sample  your 
opinions  about  a  variety  of  people  and  situations.  There  are  no  right  or 
wrong  answers.  What  is  wanted  is  your  own  individual  feeling  about  the 
statements.  Read  each  statement  and  decide  how  YOU  feel  about  it.  Then 
mark  your  answers  on  the  space  provided  on  the  answer  sheet.  Do  not 
make  any  marks  on  this  booklet. 


If  you  strongly  agree,  blacken  space  under  “SA” . 

If  you  agree,  blacken  space  under  “A” . 

If  you  are  undecided  or  uncertain,  blacken  space  under  “U”.  .  .  . 

If  you  disagree,  blacken  space  under  “D” . 

If  you  strongly  disagree,  blacken  space  under  “SD” . 

Think  in  terms  of  the  general  situation  rather  than  specific  ones. 
There  is  no  time  limit,  but  work  as  rapidly  as  you  can.  PLEASE  RESPOND 
TO  EVERY  ITEM. 


IA 

A 
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0 
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1 
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A-l 


SA- -Strongly  agree 
A-- Agree 


U- -Undecided 
or  uncertain 


D--  Disagree 
SD- -Strongly  disagree 


1.  Teaching  never  gets  monotonous. 

2.  In  high  school,  I  often  felt  that  my 
teachers  lacked  a  personal  interest 
in  me  as  an  individual. 

3.  I  enjoy  detective  or  mystery  stories. 

4.  Increased  freedom  in  the  classroom 
creates  confusion. 

5.  I  often  felt  "left  out”  of  school 
social  and  recreational  activities. 

6.  At  times  I. have  very  much  wanted 
to  leave  home. 

7.  Once  in  a  while  I  think  of  things  too 
bad  to  talk  about. 

8.  Students  should  not  respect  teachers 
anymore  than  any  other  adults. 

9.  I  sometimes  think  I  kept  to  myself 
more  than  I  should  have  in  high 
school. 

10.  I  often  think,  “I  wish  I  were  a  child 
again.” 

11.  There  is  nothing  that  can  be  more 
irritating  than  some  students. 

12.  In  general  I  did  not  dislike  my 
teachers  but  I  must  admit  I  was 
afraid  of  many  of  them. 

13.  When  someone  does  me  a  wrong  I 
feel  I  should  pay  him  back  if  I  can, 
just  for  the  principle  of  the  thing. 

14.  A  teacher  seldom  finds  young  people 
really  enjoyable. 

15.  I  would  have  enjoyed  school  more 
had  I  not  been  so  worried  about 
family  matters. 


16.  I  frequently  have  to  fight  against  show 
ing  that  I  am  bashful. 

17.  At  times  I  feel  like  swearing. 

18.  Young  people  today  are  just  as 
good  as  those  of  the  past  generation. 

19.  One  should  not  expect  students  to 
enjoy  school. 

20.  I  would  have  been  happier  in  school 
if  just  one  of  my  teachers  had  shown 
some  sympathetic  interest  towards 
my  school  problems. 

21.  Most  student  misbehavior  is  done  to 
annoy  the  teacher. 

22.  Most  of  my  teachers  in  school 
seemed  warm  and  friendly  towards 
their  pupils. 

23.  I  am  liked  by  most  people  who  know 
me. 

24.  Teachers  can  be  in  the  wrong  as 
well  as  students. 

25.  Most  of  the  subjects  I  studied  in  high 
school  seemed  a  complete  waste  of 
time. 

26.  I  am  almost  never  bothered  by  pains 
over  the  heart  or  in  my  chest. 

27.  I  do  not  always  tell  the  truth. 

28.  Whispering  should  not  be  tolerated 
in  the  classroom. 

29.  I  often  felt  I  should  leave  school 
since  I  didn’t  seem  to  be  ac¬ 
complishing  anything. 

30.  As  a  youngster  I  was  suspended 
from  school  one  or  more  times  for 
cutting  up. 
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A-2 


SA- -Strongly  agree 
A--Agree 


U--Undecided 
or  uncertain 


D- -Disagree 
SD--Strongly  disagree 


31.  At  times  I  have  wished  I  were  a  girl. 

32.  Teachers  should  exercise  more  au¬ 
thority  over  their  students  than  they 
do. 

33.  If  I  had  to  conform  to  the  same  cur¬ 
riculum  requirements  in  high  school 
again,  I  would  be  tempted  to  quit 
school. 

34.  I  often  get  discouraged  about  amount¬ 
ing  to  something. 

35.  Young  people  are  usually  too  soc¬ 
iable  in  the  classroom. 

36.  I  often  desired  to  "play  hooky”  and 
do  something  else  rather  than  go  to 
school. 

37.  I  am  certainly  lacking  in  self- 
confidence. 

38.  Young  people  nowadays  are  too 
frivolous. 

39.  My  high  school  principal  was  a  cold, 
unsympathetic  sort  of  person. 

40.  Most  students  are  resourceful  when 
left  on  their  own. 

41.  I  think  most  people  would  lie  to  get 
ahead. 

42.  Young  people  are  not  mature  enough 
to  make  their  own  decisions. 

43.  While  in  high  school  I  couldn’t 
escape  the  feeling  that  I  should  be 
out  earning  money  to  help  my 
parents  instead  of  staying  in  school. 

44.  There  is  too  great  an  emphasis 
upon  "keeping  order”  in  the  class¬ 
room. 


45.  I  do  not  read  every  editorial  in  the 
newspaper  every  day. 

46.  In  general,  I  enjoyed  school  and 
seldom  felt  bored  or  restless. 

47.  Students  should  be  allowed  more 
freedom  in  their  execution  of  learn¬ 
ing  activities. 

48.  I  can  say  in  all  truthfulness  that 
while  in  school  I  got  along  quite  well 
with  my  fellow  students. 

49.  I  get  angry  sometimes. 

50.  In  school  I  was  sometimes  sent  to 
the  principal  for  cutting  up. 

51.  All  persons  should  know  the  funda¬ 
mentals  of  English  grammar  by  the 
first  year  of  high  school. 

52.  The  subjects  we  studied  in  high 
school  just  didn’t  seem  very 
practical  to  me. 

53.  Most  people  will  use  somewhat  un¬ 
fair  means  to  gain  profit  or  an 
advantage  rather  than  to  lose  it. 

54.  Once  in  a  while  I  put  off  until 
tomorrow  what  I  ought  to  do  today. 

55.  The  student  who  misbehaves  should 
be  made  to  feel  guilty  and  ashamed 
of  himself. 

56.  In  high  school  1  had  many  friends 
and  acquaintances. 

57.  I  believe  that  my  home  life  is  as 
pleasant  as  that  of  most  people  I 
know. 

58.  I  disliked  my  studies  in  high  school. 

59.  Sometimes  I  feel  as  if  I  must  injure 
either  myself  or  someone  else. 
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A-3 


SA- -Strongly  agree 
A- -Agree 


U--Undecided 
or  uncertain 


D--Disagree 
SD- -Strongly  disagree 


60.  Sometimes  when  I  am  not  feeling 
well  I  am  cross. 

61.  One  should  be  able  to  get  along  with 
almost  any  student. 

62.  I  often  felt  that  1  just  didn’t  "belong” 
while  in  school. 

63.  A  student  who  bites  his  nails  needs  to 
be  made  to  feel  ashamed. 

64.  My  parents  didn’t  really  care  whether 
I  finished  school  or  not. 

65.  Young  people  will  think  for  them¬ 
selves  if  permitted. 

66.  There  is  no  excuse  for  the  extreme 
sensitivity  of  some  students. 

67.  My  parents  seemed  to  think  I  was 
wasting  time  in  school  and  should 
be  out  earning  money. 

68.  My  table  manners  are  not  quite  as 
good  at  home  as  when  I  am  out  in 
company. 

69.  Students  just  cannot  be  trusted. 

70.  I  am  against  giving  money  to  beg¬ 
gars. 

71.  Most  students  are  not  interested  in 
learning, 

72.  While  in  school  I  often  felt  like 
“chucking  it  all”  and  getting  a  job. 

73.  I  enjoy  many  different  kinds  of 
play  and  recreation. 

74.  My  parents  have  often  objected  to 
the  kind  of  people  I  went  around  with. 

75.  Minor  disciplinary  situations  should 
sometimes  be  turned  into  jokes. 


76.  If  the  teacher  laughs  with  the  stu¬ 
dents  in  amusing  classroom  sit¬ 
uations,  the  class  tends  to  get  out  of 
control. 

77.  I  should  like  to  belong  to  several 
clubs  or  lodges. 

78.  While  a  student  it  often  seemed 
to  me  that  I  would  be  utilizing 
my  time  to  greater  advantage  by 
working  and  gaining  job  exper¬ 
ience  than  by  going  to  school. 

79.  I  hardly  ever  notice  my  heart  pound¬ 
ing  and  I  am  seldom  short  of  breath. 

80.  If  I  could  get  into  a  movie  without 
paying  and  be  sure  I  was  not  seen  I 
would  probably  do  it. 

81.  A  young  person’s  companionships  can 
be  too  carefully  supervised. 

82.  The  first  lesson  a  student  needs  to 
learn  is  to  follow  the  teacher’s  in¬ 
structions  w^.hout  hesitation. 

83.  I  never  felt  I  could  afford  to  waste 
time  by  participating  in  school  social 
or  recreational  activities. 

84.  I  would  rather  win  than  lose  in  a 
game. 

85.  A  student’s  failure  is  seldom  the 
fault  of  the  teacher. 

86.  I  don’t  blame  anyone  for  trying  to 
grab  everything  he  can  get  in  this 
world. 

87.  I  can  be  friendly  with  people  who  do 
things  which  I  consider  wrong. 

88.  A  teacher  should  not  be  expected  to 
burden  himself  with  a  student’s 
problems. 
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89.  Sometimes  at  elections  I  vote  for 
men  about  whom  I  know  very  little. 

90.  A  teacher  should  not  be  expected  to 
sacrifice  an  evening  at  home  in 
order  to  confer  with  a  student  (or 
his  family). 

91.  My  parents  encouraged  my  school 
progress  and  wanted  me  to  finish 
school. 

92.  If  I  were  an  artist  I  would  like  to 
draw  flowers. 

93.  I  like  to  know  some  important 
people  because  it  makes  me  feel 
important . 

94.  Young  people  should  be  taught  to 
obey  adults  without  question. 

95.  In  high  school,  I  felt  that  some  of  my 
teachers  disliked  me. 

96.  Once  in  a  while  I  feel  hate  toward 
members  of  my  family  whom  I 
usually  love. 

97.  I  do  not  like  everyone  I  know. 

98.  A  student  should  not  be  required  to 
stand  when  reciting. 

99.  I  am  sure  I  am  being  talked  about. 

100.  There  is  too  much  emphasis  on 
grading. 

101.  I  work  under  a  great  deal  of  tension. 

102.  The  school  is  often  to  blame  in  cases 
of  truancy. 

103.  I  am  so  touchy  on  some  subjects  that 
I  can’t  talk  about  them. 

104.  Most  students  would  like  to  use  good 
English. 


105.  In  school  I  found  it  very  hard  to  talk 
before  the  class. 

106.  Young  people  nowadays  are  allowed 
too  much  freedom  in  'school. 

107.  During  one  period  when  I  was  a  young¬ 
ster  I  engaged  in  petty  thievery. 

108.  Most  students  try  to  make  things 
easier  for  the  teacher. 

109.  I  think  nearly  anyone  would  tell  a  lie 
to  keep  out  of  trouble. 

110.  Most  teachers  do  not  give  sufficient 
explanation  in  their  teaching. 

111.  The  things  that  s^me  of  my  family 
have  done  have  frightened  me. 

112.  I  gossip  a  little  at  times. 

• 

113.  Students  should  be  given  more  free¬ 
dom  in  the  classroom  than  they  usually 
get. 

114.  It  isn’t  practicable  to  base  school 
work  upon  student’s  interests. 

115.  Young  people  are  given  too  much 
freedom. 

116.  Sometimes  I  becom  ;  so  excited 
that  I  find  it  hard  to  get  to  sleep. 

117.  I  tend  to  be  on  my  guard  with 
people  who  are  somewhat  more 
friendly  than  I  had  expected. 

118.  Most  students  are  considerate  of 
their  teachers. 

119.  I  have  several  times  given  up  doing 
a  thing  because  I  thought  too  little 
of  my  ability. 

120.  I  am  not  easily  angered. 
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121.  Shy  students  should  be  required  to 
stand  when  reciting. 

122.  As  a  rule  teachers  are  too  lenient 
with  their  students. 

123.  I  frequently  ask  people  for  advice. 

124.  Often,  even  though  everything  is 
going  fine  for  me,  I  feel  that  I  don't 
care  about  anything. 

125.  Young  people  are  so  likeable  that 
their  shortcomings  can  usually  be 
overlooked. 

126.  Once  in  a  while  I  laugh  at  a  dirty 
joke. 

127.  I  cannot  keep  my  mind  on  one  thing. 

128.  It  is  usually  the  uninteresting  and  dif¬ 
ficult  subjects  that  will  do  the  student 
the  most  good. 

129.  The  student  who  stutters  should  be 
asked  to  recite  more  often. 

130.  Teachers  probably  over -emphasize  the 
seriousness  of  such  student  behavior  as 
the  writing  of  obscene  notes. 

131.  I  would  certainly  enjoy  beating  a  crook 
at  his  own  game. 

132.  It  would  be  better  if  almost  all  laws 
were  thrown  away. 

133.  Young  people  act  more  civilized  than 
do  many  adults. 

134.  A  student  has  the  right  to  disagree 
openly  with  his  teachers. 

135.  I  like  or  have  liked  fishing  very 
much. 

136.  It’s  the  students  who  actually  keep  a 
teacher  interested  in  teaching. 


137.  I  like  to  read  newspaper  editorials. 

138.  There  are  certain  people  whom  I 
dislike  so  much  that  I  am  inwardly 
pleased  when  they  are  catching  it 
for  something  they  have  done. 

139.  I  am  often  inclined  to  go  out  of  my 
way  to  win  a  point  with  someone  who 
has  opposed  me. 

140.  I  like  to  poke  fun  at  people. 

141.  Science  has  its  place,  but  there  are 
many  important  things  that  can  never 
possibly  be  understood  by  the  human 
mind. 

142.  If  I  were  in  trouble  with  several  friends 
who  were  equally  to  blame,  I  would 
rather  take  the  whole  blame  than  to 
give  them  away. 

143.  While  in  trains,  busses,  etc.,  I  often 
talk  to  strangers. 

144.  People  can  be  divided  into  two  distinct 
classes:  the  weak  and  the  strong. 

145.  I  usually  “lay  my  cards  on  the  table” 
with  people  that  I  am  trying  to  correct 
or  improve. 

146.  I  think  if  my  health  had  been  better 
I  would  have  enjoyed  school  more. 

147.  The  wild  sex  life  of  the  old  Greeks 
and  Romans  was  tame  compared  to 
some  of  the  goings-on  in  this  country, 
even  in  places  where  people  might 
least  expect  it. 

148.  People  can  pretty  easily  change  me 
even  though  I  thought  that  my  mind 
was  already  made  up  on  a  subject. 

149.  I  can  stand  as  much  pain  as  others 
can. 
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150.  Sometimes  I  enjoy  hurting  persons 
I  love. 

151.  Teachers  need  to  be  keen  students 
of  human  nature. 

152.  1  never  attend  a  sexy  show  if  I  can 
avoid  it. 

153.  Young  people’s  wants  are  just  as 
important  as  those  of  an  adult. 

154.  I  am  greatly  bothered  by  forgetting 
where  I  put  things. 

155.  Most  people  are  pretty  easy  to  get  along 
with. 

156.  Imaginative  tales  demand  the  same 
punishment  as  lying. 

157.  On  the  whole,  the  punishment  I  re¬ 
ceived  as  a  child  was  just  about 
right,  neither  too  much  nor  too 
little. 

158.  I  very  much  like  horseback  riding. 

159.  Being  able  to  get  along  with  people 

is  the  most  important  asset  a  person 
can  have. 

160.  Most  students  respond  well  to  con¬ 
structive  suggestions. 

161.  In  high  school,  I  had  a  lot  of  difficulties 
with  my  teachers. 

162.  In  mo3t  respects,  other  people  are 
very  much  like  myself. 

163.  What  a  teacher  sees  in  his  class  is 
largely  determined  by  what  he  is. 

164.  Good  teachers  are  more  important  to  a 
community  than  are  good  doctors. 

165.  Sometimes  it  is  useless  to  try  to 
reason  with  a  child. 


166.  I  have  little  difficulty  controlling  my 
temper. 

167.  I  dislike  having  to  explain  things 
to  others. 

168.  It  bothers  me  greatly  to  violate  a 
confidence. 

169.  In  school,  I  rarely  received  high 
marks  in  deportment. 

170.  I  frequently  get  into  difficulty 
through  people  misunderstanding 
my  intentions. 

171.  I  often  feel  that  people  misunder¬ 
stand  me. 

172.  Learning  the  names  of  new  ac¬ 
quaintances  comes  easily  for  me. 

173.  I  often  feel  others  expect  too  much 
of  me. 

174.  I  dislike  speaking  before  a  group. 

175.  There  are  quite  a  few  people  who 
are  so  irritating  it  is  practically 
impossible  to  get  along  with  them. 

176.  It  is  often  impossible  to  live  up  to 
what  others  expect  of  a  person. 

177.  I  read  the  sports  section  of  the  paper 
every  chance  I  get. 

178.  I  ran  away  from  home  one  or  more 
times  before  I  was  18. 

179.  Any  criticisms  I  have  received  from 
superiors  have  usually  been  justified. 

180.  When  given  a  task  to  do,  I  am  prob¬ 
ably  more  conscientious  than  most 
people  in  trying  to  carry  it  out  suc¬ 
cessfully. 

181.  I  am  a  big  league  baseball  fan. 
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182.  I  never  carry  a  grudge  for  very 
long. 

183.  In  most  ways,  women  are  defin¬ 
itely  superior  to  men. 

184.  There  are  too  many  silly  laws  and 
regulations  for  people  to  live  up  to. 

185.  If  a  person  in  authority  wants  to 
take  advantage  of  others  because  of 
his  position,  that  is  his  privilege. 


186.  There  is  hardly  anything  more 
satisfying  than  knowing  you  have 
done  a  job  well. 

187.  Whenever  I  am  criticized,  I  rarely 
let  any  resentment  I  feel  get  out  of 
hand. 

188.  I  think  I  would  like  teaching  as  a 
career. 
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35 

68 

1 

10 

1 

2 

93 

29. 

46 

56 

70 

4 

9 

6 

0 

79 

30. 

68 

64 

64 

3 

5 

3 

1 

108 

31. 

53 

65 

73 

1 

2 

2 

1 

124 

32. 

42 

34 

46 

0 

19 

6 

0 

92 

33. 

64 

65 

74 

1 

0 

1 

0 

103 

34. 

57 

75 

70 

1 

2 

0 

0 

115 

35. 

52 

55 

58 

0 

8 

3 

0 

103 

36. 

50 

54 

65 

4 

9 

6 

1 

77 

37. 

71 

62 

71 

1 

7 

4 

1 

121 

38. 

49 

61 

66 

1 

6 

1 

1 

101 

39. 

53 

65 

60 

1 

11 

12 

1 

106 

40. 

57 

62 

71 

0 

9 

2 

0 

118 

41. 

67 

62 

67 

5 

3 

3 

1 

107 

42. 

53 

61 

69 

0 

4 

0 

1 

97 

43. 

60 

68 

64 

1 

3 

0 

1 

106 

44. 

79 

59 

75 

6 

4 

7 

3 

104 

45. 

52 

70 

67 

0 

6 

2 

2 

114 

46. 

63 

39 

49 

2 

19 

4 

0 

93 

47. 

50 

44 

46 

0 

16 

5 

0 

79 

48. 

50 

58 

75 

0 

3 

3 

0 

115 

49. 

48 

67 

72 

0 

3 

0 

1 

107 

50. 

48 

43 

64 

2 

15 

6 

1 

95 

51. 

60 

59 

65 

3 

9 

9 

0 

99 

52. 

44 

50 

65 

1 

8 

4 

0 

99 

^Criterion  (combined  ratings) 
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